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Abstract 

Constructing numerical models of noisy partial differential equa- 
tions is very delicate. Our long term aim is to use modern dynam- 
ical systems theory to derive discretisations of dissipative stochastic 
partial differential equations. As a second step we here consider a 
small domain, representing a finite element, and apply stochastic cen- 
tre manifold theory to derive a one degree of freedom model for the 
dynamics in the element. The approach automatically parametrises 
the microscale structures induced by spatially varying stochastic noise 
within the element. The crucial aspect of this work is that we ex- 
plore how a multitude of noise processes may interact in nonlinear 
dynamics. We see that noise processes with coarse structure across 
a finite element are the significant noises for the modelling. Further, 
the nonlinear dynamics abstracts effectively new noise sources over 
the macroscopic time scales resolved by the model. 
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1 Introduction 



The ultimate aim is to accurately and efficiently model numerically the evolu- 
tion of stochastic partial differential equations (spdes) as, for example, may 
be used to model pattern forming system [T4^ E] . Due to the forcing over 
many length and time scales, a spde typically has intricate spatio-temporal 
dynamics. Numerical methods to integrate stochastic ordinary differential 
equations are known to be delicate and subtle [20J e.g.]. We surely need to 
take considerable care for spdes as well [TTJIUIJ e -g-]- 

An issue is that the stochastic forcing generates high wavenumber, steep 
variations, in spatial structures. Stable implicit integration in time generally 
damps far too fast such decaying modes, yet through stochastic resonance 
an accurate resolution of the life-time of these modes may be important 
on the large scale dynamics. We use the term "stochastic resonance" to 
include phenomena where stochastic fluctuations interact with each other 
and themselves through nonlinearity in the dynamical system to generate not 
only long time drifts but also potentially to change stability [2TJ El UH OH HUE 
e.g.] as seen here in equation (0J). Thus we must reasonably resolve subgrid 
microscale structures so that numerical discretisation with large space-time 
grids achieve efficiency without sacrificing the subtle interactions that take 
place between the subgrid scale structures. 

Centre manifold theory supports the macroscopic modelling of micro- 
scopic dynamics. For example, Knobloch & Wiesenfeld j2Ij and Boxler [SJ [7j 
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explicitly used centre manifold theory to support the modelling of SDEs and 
SPDEs. Indeed, Boxler jH] proves that "stochastic center manifolds, share all 
the nice properties of their deterministic counterparts." Many others, such as 
Berglund & Gentz Blomker, Hairer & Pavliotis [Sj and Kabanov & Perga- 
menshchikov ^Hj , use the same separation of time scales that underlies centre 
manifold theory to form and support low- dimensional, long therm models of 
SDEs and SPDEs that have both fast and slow modes. A centre manifold ap- 
proach also illuminates the discretisation of deterministic partial differential 
equations [2E1 EU 1221 EH1 1321 E3J • By merging these two applications of centre 
manifold theory we will model SPDEs with sound theoretical support; here 
we begin to develop good methods for the discretisation of SPDEs. Here we 
consider the case of just one finite element forming the domain. Later work 
will address how to couple many finite elements together to form a large scale 
discrete model of SPDEs. The crucial issue explored here is how to deal with 
noise that is distributed independently across space as well as time, that is, 
the noise is un correlated in space and time. We decompose the noise into 
its Fourier sine series and assume the infinite number of Fourier coefficients 
are an infinite number of independent noise sources. It eventuates that only 
a few combinations of these noise sources are important in the long term 
model. However, all do contribute in the infinite sums forming these few 
combinations. 

The importance of this work is to establish a methodology to create accu- 
rate, finite dimensional, discrete models of the long term dynamics of SPDEs. 

Analyse a prototype SPDE Continuing earlier work jHl], the simplest 
case, and that developed here, is the modelling of a SPDE on just one finite size 
element. As a prototype, let us consider the stochastically forced nonlinear 
partial differential equation 



which involves the importantgeneric physical processes of advection uu x , dif- 
fusion u xx , some noise process 4>(x, t), and a linear reaction u that partially 
ameliorates diffusion to make the sin x mode dynamically neutral. Our pri- 
mary aim is to work with the forcing by cb(x, t), of strength 0", being a white 
noise process that is delta correlated in both space and time. Here we express 
the additive noise in the orthogonal sine series 





OG 




(2) 
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where the 4>ic(t) are independent white noises that are delta correlated in 
time. 1 Our aim is to seek how the complex interactions, through the non- 
linearity of the prototype spde (JTJ), of these spatially distributed noises 
affect the dynamics over the relatively large scale domain [0,n]. Analo- 
gously, Blomker et al. [Sj rigorously modelled the stochastically forced Swift- 
Hohenberg equation by a stochastic Ginzburg-Landau equation as a proto- 
type SPDE in a class of pattern forming stochastic systems. 

Throughout the body of this paper, we interpret all noise processes and 
all stochastic differential equations in the Stratonovich sense so that the rules 
of traditional calculus apply. Thus the direct application of this modelling is 
to physical systems where the Stratonovich interpretation is the norm. How- 
ever, the Appendix provides alternative proofs of some key properties of the 
nonlinear interaction of noise processes: these proofs use the Ito interpreta- 
tion. Only in the Appendix is the Ito interpretation used, everywhere else 
the stochastic calculus is Stratonovich. 



Centre manifold theory supports the modelling We base the mod- 
elling upon the dynamics when the noise is absent, cr = . When cr = the 
linear dynamics of the spde (JTJ, described by 

3u 3 2 u . , . /n . 

— — = -— r+u such that u = at x = 0, 7t , (3) 
ot ox 1 

are that modes u oc sinkxexp At decay with rate = — (k 2 — 1 ) except for 
the k = 1 mode, u oc sinx, which is linearly neutral, Ai = , and thus forms 
the basis of the long term model. The components of the forcing noise (j2J 
with wavenumber k > 1 are orthogonal to this basic mode. Consequently, 
simple numerical methods, such as Galerkin projection onto the fundamen- 
tal mode sin x , would ignore the "high wavenumber" modes, k > 1 , of the 
noise (j2J) and hence completely miss subtle but important subgrid interac- 
tions. Instead, the systematic nature of centre manifold theory accounts for 
the subgrid scale interactions as a power series in the noise amplitude cr from 
the deterministic base (jUJ). 

Centre manifold theory applies to the nonlinear forced system (0) be- 
cause in the linearised problem © there is some (here one) eigenvalue of 
and all the other eigenvalues are negative (and bounded away from 0). Af- 
ter adjoining the trivial da/ dt = , theory assures us that in some finite 
neighbourhood of (u, cr) = (0,0) there exists jHl Theorem 5.1 and 6.1] a 

lr The reason for expressing the noise in the sine expansion (j2J) is that the modes sinkx 
are the eigenmodcs of the linear dynamics and thus form a natural basis for analysis. 
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centre manifold u = v(a(t), x, t, a) where the amplitude a of the neutral 
mode sinx evolves according to d = g(a,t,cr) for some function g. Un- 
fortunately, there is a caveat: Boxler's [B] theory is as yet developed only 
for finite dimensional systems which satisfy a Lipschitz condition. Here, 
the spde ((H) is infinite dimensional and the nonlinear advection ufy in- 
volves the unbounded operator There is some infinite dimensional the- 
ory: Blomker et al. Theorem 1.2] rigorously proved the existence and 
relevance of a stochastic Ginzburg-Landau model to the stochastic forced 
Swift-Hohenberg pde; further, Caraballo, Langa & Robinson jH] and Duan, 
Lu & Schmalfuss ^Hj proved the existence of invariant manifolds for a wide 
class of reaction-diffusion spdes; they built on earlier work on inertial man- 
ifolds in spdes by Bensoussan & Flandoli I expect future theoretical 
developments to rigorously support the approach. 

However, in the interim, a way to proceed is via a shadowing argument. 
The rapid dissipation of high wavenumber modes in (£Q), the spectrum ~ 
— k 2 for large wavenumber k, ensures that the dynamics of the spde $IJ 
is close enough to finite dimensional. By modifying the spatial derivatives 
in (0) to have a high wavenumber cutoff, the dynamics of the spde (£Q) is 
effectively that of a Lipschitz, finite dimensional system. The theorems of 
Boxler [S| then rigorously apply. For example, the modelling in Section H] 
shows that just ten spatial modes in the noise cb(x, t) gives the coefficients in 
the model ()24)1 correct to five decimal digits. Thus modifying 3/3x to cutoff 
modes with wavenumber k > 20 is a nearby, Lipschitz, finite dimensional 
SDE system that is effectively indistinguishable from the original spde to 
five decimal digits and to the order of asymptotic expansion pursued here. 
Whenever theoretical support by Boxler jH] is invoked, I actually refer to this 
slightly modified system. 

Stochastic induced drift affects stability Previously |H4] . I discussed 
that when the sin2x component of the noise (0) is large enough, and in the 
absence of any other noise component, then stochastic resonance may make 
a qualitative change in the nature of the solutions in that it restabilises the 
zero equilibrium. The model described the evolution of the amplitude a(t) 
of the sin x mode as 

a « -ga - f 2 a 3 + ±aacb 2 + ^cr 2 aO , (4) 

for some white noise O(t) independent of (i>2 over long times. The sec- 
ond key theorem of centre manifolds is that models such as (j3J) do capture 
the long term dynamics of the original stochastic system (£Q). For example, 
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Theorem 7.1(i) [B| assures us that all nearby solutions of the spde expo- 
nentially quickly in time approach a solution of the model (@J embedded on 
the centre manifold u = v(a(t),x,t, cr) . This property is sometimes called 
"asymptotic completeness" [HE]- It assures us that apart from exponentially 
decaying transients, models such as (J3J potentially describe all the long term 
dynamics of the original system. 

Although the nonlinearity induced stochastic resonance generates the ef- 
fectively new multiplicative noise, oc a 2 aO , its most significant effect is 
the enhancement of the stability of the equilibrium a = through the 
a 2 a/88 term. For examples, Boxler [HI p. 544], Drolet & Vinals [T31 Ej 
and Knobloch & Weisenfeld [2^ and Vanden-Eijnden [211 p. 68] found the 
same sort of stability modifying linear term in their analyses of stochastically 
perturbed bifurcations and systems. Boxler [HI Theorem 7.3(a)] proves that 
the stability of an original SDE is the same as the model SDE on the stochas- 
tic centre manifold. Analogously to these effects of microscale noise on the 
macroscale dynamics, Just et al. sought to determine how microtime 
deterministic chaos, not noise, translates into a new effective stochastic noise 
in the slow modes of a deterministic dynamical system. Here we explore 
further the modelling of such induced changes to the stability of the sys- 
tem through the transformation by nonlinearity of microscale noise into 
macroscale drift and noise. Indeed, our more complete analysis here shows 
that noise in all other spatial modes contribute to destabilise the equilibrium, 
see (J211). 

The approach For the first part of the analysis, Sections El and [21 the 

requirement of white, delta correlated noise is irrelevant; the results are valid 
for quite general time dependent, additive forcing. In these two sections we 
show how to remove "memory" integrals over the past history of the noise, 
Section El However, in a nonlinear system there are effects quadratic in the 
noise processes; in Section [21 the techniques reduce the number of memory 
integrals but cannot eliminate them all. In the second part of the analy- 
sis, Sections |U and EJ the critical assumption of white, delta correlated noise 
enables analysis of the nonlinear interactions. Modelling the Fokker-Planck 
equations of the irreducible quadratic noises shows that their probability 
density functions (pdfs) approximately factor into a multivariate Gaussian 
and a slowly evolving conditional probability, such a factorisation is also the 
key to the modelling by Just et al. jTH] of fast deterministic chaos as noise on 
the slow modes. This factorisation abstracts effectively new noise processes 
over the long time scales of interest in the model. Section [U discusses the 
specifics, such as the appropriate version of (J3J), for the spde with delta 
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correlated noise in space and time; whereas Section El presents generic trans- 
formations of the irreducible quadratic noises for use in analysing general 
SDEs. Appendix |X] provides alternate proofs, using Ito calculus, of some of 
the key results in the modelling of nonlinear interactions among the noise 
components. 

2 Construct a memoryless normal form 
model 

The centre manifold approach identifies that the long term dynamics of 
a spde such as JTJ) is parametrised by the amplitude a(t) of the neutral 
mode sin x . Arnold et al. £Q investigated stochastic Hopf bifurcations this 
way, and the approach is equivalent to the slaving principle for SDEs used 
by Schoner & Haken jHZj. However, most researchers generate models with 
convolutions over fast time scales of the noise [HH §2, e.g.]. Here we keep the 
model tremendously simpler by removing these 'memory' convolutions. This 
removal of convolutions was originally developed for SDEs by Coullet, Elphick 
& Tirapegui ^2j, Sri Namachchivaya & Lin j2B], and Roberts & Chao [9| I34j . 

As discussed, centre manifold theory supports the models we consider 
herein. However, crucial features of the model reflect the steps taken to 
construct the model; thus the next two sections discuss the iterative con- 
struction. However, note that centre manifold theorems only depend upon 
certain basic properties and that the residuals of the governing equations are 
of some specified order of smallness. For example, Boxler [HI Theorem 8.1] 
assure us that if we satisfy the spde (JTJ) to some residual C(||(a, 0")|| q ), then 
the stochastic centre manifold and the evolution thereon have the same order 
of error. Note that the amplitude a and the noise intensity cr are the small pa- 
rameters in the asymptotic expansions forming the model. The support such 
theorems give to our modelling is independent of the details of construction. 
One complication is that I construct models to residuals of (9 (a 4 + cr 2 ), for 
example. Theory covers this when we simply define a new small parameter 
e = cr 1/2 , then a residual of C(a 4 + cr 2 ) = C(||(a, e)|| 4 ), for example; hence 
the theorem applies to assure us the errors are of 0[\\ (a, e) || 4 ) = C ) (a 4 +cr 2 ) , 
for example. I use this latter form to report the residuals and errors. Because 
the critical aspect of constructing the centre manifold model is simply the 
ultimate order of the residual of the spde (0), the specific details of the com- 
putation are not recorded here. Instead computer algebra [HHl §1] performs 
all the details. Here I just report on critical steps in the method. 
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Consider the task of iteratively constructing a stochastic model for the 
SPDE (|TJ using iteration [21] • We seek solutions in the form u = v(a, x, t, cr) = 
a sin x + • • • such that the amplitude a evolves according to some prescrip- 
tion d = g(a, t, cr) , such as (J3J. The steps in the construction proceed iter- 
atively. Suppose that at some stage we have an asymptotic approximation 
to the model, then the next iteration is to seek small corrections, denoted 
v' and g', to improve the asymptotic approximation. As the iterations pro- 
ceed, the small corrections v' and g' get systematically smaller, that is, of 
higher order in the small parameters a and cr of the asymptotic exapnsion. 
As explained in [2H], substitute u = v + v' and d = g + g' into the SPDE (JTJ), 
linearise the problem for v' and g' by dropping products of small corrections, 
and obtain that the corrections should satisfy 

9v' aV 



at 



— j — v + g sinx = residual qj. 



Here the "residual" is the residual of the SPDE (P) evaluated for the currently 
known asymptotic approximation. For example, if at some stage we had 
determined the deterministic part of the model was 

u = a sinx — -|a 2 sin2x + -^a 3 sin3x + 0(a 4 , cr) 
such that d = — ^a 3 + C(a 4 , cr) , 

then the residual of the SPDE (JJ for the next iteration would be simply the 
stochastic forcing, 

oo 

residual [jj = d) k sinkx + C(a 4 ) . 

k=1 

The terms in the residual split into two categories, as is standard in singular 
perturbations: 

• the components in sinkx for k > 2 cause no great difficulties, we in- 
clude a corresponding component in the correction v' to the field in 
proportion to sinkx — when the coefficient of sinkx in the residual is 
time dependent the component in the correction v' is Hk<bkW sinkx 
in which the operator Hy denotes convolution over past history with 
exp[-(k 2 -l)t]; 2 

• but any component in sinx, such as cbi in this iteration with this resid- 
ual, must cause a contribution to the evolution correction g', here sim- 
ply g' = <bi , as no uniformly bounded component in v' of sinx can 



2 Namely = exp[-(k 2 - 1)t] *<|>(t) = J* cxp[-(k 2 - 1)(t- t)]<J>(t) dr. 
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match a sin x component of the residual — this is the standard solvabil- 
ity condition for singular perturbations. 

However, a more delicate issue arises for the next corrections. In the next 
iteration the next 

residual jjj = a ex jH2^>2smx + (|cbi + 7^3(^3) sin2x 

k 

+ T- 2 ( ^ k + lCt)k + 1 -?4-i4>k-i)sinkx] +G(a 4 + (T 2 ). (5) 

k=3 

Many are tempted to simply use the solvability condition and match the sin x 
component in this residual directly by the correction ao^Hz^i to the evolu- 
tion g'. But this choice introduces incongruous short time scale convolutions 
of the forcing into the model (j3J) of the long time evolution. The appropriate 
alternative [T21 HI HH] is to recognise that part of the convolution can be 
integrated: since for any ®(t), -^7i k ® = -(k 2 - 1 )7Y k O + <P , thus 



k 2 -1 



at 



(6) 



and so split such a convolution in the residual, when multiplied by the neutral 
mode sinx, into: 

• the first part, — -^T-l^O / {~\c 2 — 1) , that is integrated into the next up- 
date v' for the subgrid field; 

• and the second part, <D/(k 2 — 1 ) , that updates d' in the evolution. 

For the example residual (0), the term ^ao"7i2 ( J ) 2si n x i n the residual thus 
forces a term — |acx7Y24 ) 2sinx into the subgrid field, and a term |acr<J)2 into 
the evolution d. When the residual component has many convolutions, then 
apply this separation recursively. Consequently, all fast time convolutions 
linear in the forcing are removed from the evolution equation for the ampli- 
tude a(t). 

Continuing this iterative construction gives more and more accurate mod- 
els. The iteration terminates when the residuals are zero to some specified 
order. Then the Approximation Theorem of centre manifold theory Theo- 
rem 8.1] assures us that the model has the same order of error as the residual. 

For example, terminating the iterative construction so that residual^ = 
0(a 4 + a 2 ) , we find the field 

00 

u = asinx — ^a 2 sin2x + ^a 3 sin3x + a J~ sin kx 

k=2 
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+ acr 



— \ r ri2§2 sin x + {\H2<&\ + HiHzfe) sin2x 



-=Hy{Hy+\ ct> k+1 - W k _i 4) k _! ) sin kx 



k=3 



+ 0(a 4 + cr 2 ). 



(7) 



The corresponding model for the evolution, 



d = -^a 3 + act)! + iacrfo + a 2 cr(^ch + + C(a 5 + a 2 ) , (8) 



has no fast time convolutions, only the direct influence of the forcing. This 
is the normal form for a noisy model. 

Note the generic feature that the originally linear noise, through the non- 
linearities in the system, appears as a multiplicative noise in the model. But 
it is only the coarse structure of the noise that appears in the model: all noise 
with wavenumber k > 3 is ineffective in these the most important terms in 
a model. 

3 Quadratic noise has irreducible 
interactions 

Continue the iterative construction of the stochastic centre manifold model 
to effects quadratic in the magnitude cr of the noise. We seek terms in cr 2 as 
these generate mean drift terms, and also seek terms in acr 2 as these affect 
the linear stability of the spde flU) [Ml Figure 2] and p. 544]. 

Computer algebra [HHl §1-1—4] determines the stochastic model evolution 



1 3 7 
a = -12 a - 3456 a 



5 



+ crcp! + Jaaq^ + aV^ch + + a 3 cr( + 




+ acr 2 [^cb^ch + ^^H 3 4> 3 + IfrHzHsfo 



oo 



oo 




k=2 
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+ Y_ Ck*TcH k _i (ft k c|> k - n k -2^-z)} +0(a 6 + a 3 ) , (9) 



k=4 

where constants 



1 



c 



2(k 2 - 1)(2k 2 -2k- 1)(2k 2 + 2k- 

4k 4 - 2k 2 + 1 
12k 2 (2k 2 - 2k - 1 ) (2k 2 + 2k - 1 ) 
k± 1 



4(2k 2 ±2k- 1 



The model (jOJ) provides accurate simulations of the original spde as 
the model is obtained through solving the spde. This accuracy will hold 
whether the forcing noise cb(x,t) is deterministic or stochastic, space-time 
correlated or independent at each point in space and time. In determinis- 
tic cases, Chicone & Latushkin's fl] theory of infinite dimensional centre 
manifolds supports (jSJ) as a model of the deterministic but nonautonomous 
pde (Q). However, we proceed to exclusively consider the case when the 
applied forcing cb(x,t) is stochastic. 

The outstanding challenge with effects quadratic in the noise is that we 
apparently cannot directly eliminate history integrals of the noise, such as 
§{H.2<§>2, from the model. 



4 Stochastic resonance affects deterministic 
terms 

Chao & Roberts EH] argued that quadratic terms involving memory inte- 
grals of the noise were effectively new drift and new noise terms when viewed 
over the long time scales of the relatively slow evolution of the model 0. 
Analogously, Just et al. ^Hj argued that fast time deterministic chaos ap- 
pears as noise when viewed over long time scales. The arguements of Chao 
& Roberts 0121] rely upon the noise being stochastic white noise. In previous 
sections, the model was a strong model in that © could faithfully track given 
realisations of the original spde [HI Theorem 7.1(i), e.g.]; however, now we 
derive a weak model, such as (jlj), which in a weak sense maintains fidelity to 
solutions of the original spde, but we cannot know which realisation because 
of the effectively new noises on the macroscale. 
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Abandon fast time convolutions The undesirable feature of the large 
time model Q is the inescapable appearance in the model of fast time 
convolutions in the quadratic noise term, namely Tizfyi = e~ 3t * cbi and 
fiiH^T, = e~ 3t *e~ 8t *(J)3. These require resolution of the fast time response 
of the system to these fast time dynamics in order to maintain fidelity with 
the original spde (0) and so incongrously require small time steps for a sup- 
posedly slowly evolving model. However, maintaining fidelity with the full 
details of a white noise source is a pyrrhic victory when all we are inter- 
ested in is the relatively slow long term dynamics. Instead we need only 
those parts of the quadratic noise factors, such as cbi7i2cbi an d fy^ifizfy?,, 
that over long time scales are firstly correlated with the other processes that 
appear and secondly independent of the other processes: these not only in- 
troduce factors in new independent noises into the model but also introduce 
a deterministic drift due to stochastic resonance (as also noted by Drolet & 
Vinal [IB]). 

In this problem, and to this order of accuracy, we need to understand 
the long term effects of quadratic noise effects taking the form <b{H v §>i and 
§>{fic{fi v §>i ■ These terms appear in the right-hand side of the evolution 
equation (JUJ) in the form d = • • • o" 2 ccbj7i p cbi • ■ ■ , for example. Equivalently 
rewrite this form as da = • • • cr 2 ccpj7-^ p cpi dt ■ ■ • . In this latter form we aim 
to replace such a noise term by a corresponding stochastic differential so 
that da = • ■ ■ cr 2 c dy-j ■ • • for some stochastic process yi with some drift 
and volatility: dy i = ( ) dt + () dW for a Wiener process W. Thus we must 
understand the long term dynamics of stochastic processes y 1 and yz defined 
via the nonlinear SDEs 

= 4>jft P 4>t and = ^jH q H v 4>i • (10) 



Canonical quadratic noise interactions To proceed following the ar- 
gument by Chao & Roberts §4.1] we name the two coloured noises that 
appear in the nonlinear terms (fTUj) . Define z-j = H p 4h and Zz = HqH v 4>i- 
From (JBJ) they satisfy the SDEs 

= -P1Z1 + cbi and =-|3 2 z 2 + zi, (11) 

dt dt 

where for this spde (JTJ) the rates of decay |3i = p 2 — 1 and (32 = q 2 — 1 • 
Now put the SDEs (1X0| and (JTTj) together: we must understand the long term 
properties of yi and y 2 governed by the coupled system 

yi =zicbj, zt =-(3 1 z 1 +cbi, 
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V2 = Z 2 4>j 



z 2 = -|3 2 z 2 + zi • 



(12) 



There are two cases to consider: when i = j the two source noises (hi and cbj 
are identical; but when i ^ ) the two noise sources are independent. 

Use the Fokker— Planck equation Following Chao & Roberts Ell 
and analogous to Just et al. [THj, we explore the long term dynamics of 
the canonical quadratic system ()12|) via the Fokker-Planck equation for the 
PDF P(y,z,t) . Vanden-Eijnden [HH] similarly uses the Kolmogorov forward 
equation to model the slow modes in SDEs. See in the canonical system (fT2"|) 
that, upon neglecting the forcing, the z variables naturally decay exponen- 
tially whereas the y variables would be naturally constant. Consequently, 
in the long-term we expect the z variables to settle onto some more-or-less 
definite stationary probability distribution, whereas the y variables would 
evolve slowly. Thus we proceed to approximately factor the joint PDF into 



where Go(z) is some distribution to be determined, depending upon the 
coefficients (3, and the quasi-PDF p(y,t) evolves slowly in time according to 
a pde we interpret as a Fokker-Planck equation for the long term evolution. 

Begin by analysing the Fokker-Planck equation for the PDF P(y,z,t) of 
the canonical system ()12j) . Recall that throughout we adopt the Stratonovich 
interpretation of SDEs; thus the Fokker-Planck equation of ()12|) is 



where the parameter s = 1 for the identical noise case i = j , whereas s = 
for the independent noise case i ^ j . 

A deterministic centre manifold captures the long term dynamics 

The first line in the Fokker-Planck equation (fT4*|) represents all the rapidly 
dissipative processes: the terms 3 Zk [p^z^P] move probability density P to 
the vicinity of z^ = 0; which is only balanced by the spread induced through 
the stochastic noise term ^P Z1Z| and the forcing term 3 Z2 [— z{9\. In contrast, 
the terms in the second line of the Fokker-Planck equation (j!4)l describes 
that the PDF P will slowly spread in the yy_ directions over long times. This 



P(y,z,t) »p(y,t)6o(z) 



(13) 



3P 
3t 




(14) 
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strong disparity in time scales leads many [T31E3IH1 e.g.] to the conditional 
factorisation However, we go further systematically by appealing to 

deterministic centre manifold theory ESI EE] • Consider the terms in the 
second line of the Fokker-Planck equation flUj) to be small perturbation 
terms through assuming that the structures in the yic variables are slowly 
varying, that is, treat 3/3'y k as asymptotically "small" parameters [2T[ 133]. 
as is appropriate over long times. Then "linearly", that is, upon ignoring 
the "small" terms in the second line, the dynamics of the Fokker-Planck 
equation (jUj) are that of exponential attraction to a manifold of equilibria 
P oc Go(z) at each y, say the constant of proportionality is p(y). Theory 
for slow variations in space [23 E2] then assures us that a centre manifold 
exists for the Fokker-Planck equation (|14[). and that all dynamics (as it is a 
liner pde) are exponentially quickly attracted to the dynamics on the centre 
manifold. The approximation theorem then assures us that the long term 
dynamics of the PDF P, when the small terms in the second line of {1$ are 
accounted for, may be expressed as a series in gradients in y of the slowly 
evolving p(y,t): using V for the vector gradient d/dy-^, the PDF 



where instead of being constant the quasi-conditional probability p evolves 
slowly in time according to a series in gradients of p in y of the Kramers- 
Moyal form [23 El ESI e.g.] 



In practice we truncate this Kramers-Moyal expansion to include up to the 
second order gradients in y for two reasons: firstly, Pawula's theorem im- 
plies any higher order truncation may lead to negative probabilities; and 
secondly, we interpret the second order truncation of the Kramers-Moyal 
expansion (fT6*j) as a Fokker-Planck equation for the long term evolution of 
the interesting y processes. Just et al. JB] i n their equation (11) similarly 
truncate to second order. Deterministic centre manifold theory assures us 
that all solutions are attracted to this model [HHI §2.2.2, e.g.]. 

Construct the long term model The approximation theorem of centre 
manifolds [33J §2.2.3, e.g.] asserts that we simply substitute the ansatz (fToT - 
[Tfi*)) into the governing Fokker-Planck equation ()14|) and solve to reduce the 
residuals to some order of asymptotic error, then the centre manifold model 
is constructed to the same order of accuracy. Here the order of accuracy is 
measured by the number of y gradients, V, as this is the small perturbation 



P(y , z, t) = G (z)p + dfz) • Vp + G 2 (z) : VVp + • • ■ , 



(15) 




(16) 
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in this problem. Consequently, for example, an error denoted as 0(V q p) 
denotes all terms of the form 3 q ' +q2 p/9-y qi 9y q2 for qi + q 2 > q . See in 



the ansatz (jToTtlbjl . anticipating the relevant parts of the model, I already 
truncated the expansions at the second order in such gradients, that is, the 
displayed part of these expansions have errors (9(V 3 p). Computer algebra 
machinations jH3 §2] driven by the residuals of the Fokker-Planck equa- 
tion (|14|) readily find the coefficients of the centre manifold model (|15H16j) . 

The computer algebra (HS §2] determines that large time solutions of the 
processes (fT2*|) have the PDF 

P = Aexp{-(p 1 + P2)[zi-2p 2 ZiZ2+MPi + P2)2||} 
x jp - s [z] - 2(3 2Zl z 2 + 2(32(13! + |3 2 )z 2 + B,] 

- s [( (3, + $ 2 )z\ + B 2 ] ^ + O ( V 2 p) } , 

for any normalisation constants A, Bi and B 2 . Simultaneously with finding 
the next order corrections to this, we find the relatively slowly varying, quasi- 
conditional probability density p evolves according to the Kramers-Moyal 
expansion 

at 



s/+B:VVp + 0(V 3 p) , 



(17) 



where the constant diffusion matrix 



D 



4(3! 



i 



P1+P2 



Translate to a corresponding SDE Interpret (JT7j) as a Fokker-Planck 
equation and see it corresponds to the SDEs 

Ui = H ; and y 2 = - — . H — ; . 19) 

2 V2^ (3t + (3 2 Vv 7 ^ 

Of course there are many coupled SDEs whose Fokker-Planck equation is (|17|): 
the reason is there are many 2x2 volatility matrices S of coupled SDEs that 
give the same diffusivity matrix D = ^S§ T ; for example, Just et al. [T5] 
choose S to be the positive definite, symmetric square root of the diffusivity 
matrix 2D. For our purposes any of the possible volatility matrices would suf- 
fice: in resorting to the Fokker-Planck equations we necessarily lose fidelity 
of paths, and now only require fidelity of distributions and correlations; as 
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commented earlier, the results is a weak model, not a strong model. For 
simplicity, obtain the form of the noise terms in (JT§j) by the unique Cholesky 
factorisation of the diffusion matrix 



^LL T for matrix L 







(20) 



Choosing the volatility matrix in the SDEs to be the lower triangular Cholesky 
matrix L ensures that nearly half the terms in the volatility matrix are zero, 
and it also ensures that when we go to higher order convolutions of noise in 
Section this 2x2 factorisation remains in the higher order factorisations, 
see d2EJ) . As argued by Chao & Roberts [§J EH and proved in Appendix |XJ 
ibt(t) are new noises independent of (fn and cbj over long time scales. The 
remarkable feature to see in the SDEs f(19jl is that for the case of identical 
noise, (Jh = cbj , that is the case s = 1 , there is a mean drift \ in the stochastic 
process yi; there is no mean drift in any other process nor in the other case, 
s =0. 

You might query the role of the neglected terms in the Kramers-Moyal 
expansions of the PDF (JT5|l and the supposed Fokker-Planck equation (JT7J). 
In the PDF (|15|) the neglected (9(V 3 p) terms provide more details of the non- 
Gaussian structure of the PDF in the slowly evolving long time dynamics. The 
effects of the neglected (9(V 3 p) terms in (fTTjl correspond to algebraically de- 
caying departures from the second order truncation that we interpret as a 
Fokker-Planck equation; Chao & Roberts jH] demonstrated this algebraic 
decay to normality in some numerical simulations (Chatwin JU] discussed 
this algebraic approach to normality in detail in the simpler situation of dis- 
persion in a channel). Such algebraically decaying transients may represent 
slow decay of non-Markovian effects among the t) variables. However, the 
truncation (fTTjl that we interpret as a Fokker-Planck equation is the lowest 
order structurally stable model and so will adequately model the dynamics 
over the longest time scales. 



Temporarily truncate the noise to simplify discussion We want to 
simplify the detailed model (jHJ) further by eliminating the nonlinear fast time 
convolutions to deduce a model nearly as simple as (@J). However, dealing 
with the infinite sums in the model Q is confusing when the focus is on 
transforming the nonlinear fast time convolutions. Thus temporarily we dis- 
cuss the case when the applied spatio-temporal noise (j2J) is truncated to the 
first three modes: (J) = 2~Ik=i 4>ic("t) sinkx . Just these three noise components 
have a range of interactions that are representative of the noise interactions 
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appearing in the model Q to the order of accuracy reported here and for 
the nonlinearity of this problem. Thus to focus on the transformations of the 
noise, temporarily consider the model (JHJ) with the truncated noise, that is, 



a 



3456 u 



+ act)! + \ao§ 2 + a 1 o{±§^ + ^cb 3 ) + a 3 o-^cb 2 

+ O 2 (l^H 2 4>2 + 12*3^2*2 + 12*2^3*3) 



^1^2*1 - i4>2^24>2 + ^^3^3^ 



4048 



19 

528 



4>i^3<h 



66 v 



^3^2*1 " ^*2H 3 H 2 *2 + lW 2 H 3 <b 3 + ^foHzHifo 



22 



23^3^4^34)3 



C(a 6 + cr 3 ) 



(21) 



Transform the strong model (J21|) to be usefully weak. The quadratic 
noises in (121)1 involve the convolutions 7^2, ^3 and which have correspond- 
ing decay rates (3 of 3, 8 and 15 respectively. Thus from the various instances 
of |TT)|) . to obtain a model for long time scales we replace the quadratic noises 
as follows: 



§{fiz§2 h-> 

$3^2*2 

Ct»2^3^3 •-> 



^1 

v/6' 

^2 
^3 

4 ' 



^1^2*1 >-» I + 

1 ^5 

(t»2^2*2 >-> ^ + 7J7| ' 

93^.3*3 >-> 2 T ' 

^7 

4 ' 

4*8 

y/6' 



4>1^3^3 •-> 



1 1 a/6 44 

4) 1^2^3*3 TT + 



44 11V6 ' 
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44 HV6' 



92 23V30 

where "Lpi > • • • > 4M2 are independent white noises, that is, derivatives of in- 
dependent Wiener processes. Thus transform the strong model ()21j) to the 
weak model 

d = "ll a3 -3436 a5 

+ c-c^ + |acrct>2 + aM^ch + JLfo) + a^fo 



2/^1 ^2 . ^3 A . 1 2 
+ cr — - H + — + -atr 



1 1 1 

+ 



aa 2 



6v/6 22V6 88J ' 2 LIS 44 4048J 
ib 4 7^5 2549 il> 6 9il. 7 , tp 8 3il>c 



18^ 242^6 4096576 704 66^ 1936 

C(a 6 + a 3 ). (22) 



| ^10 | ^11 ^12 



66V6 242V6 529^ 

Here the new noises ib^ only appear in two different combinations. Thus we 
do not need to use them individually, only their combined effect. Combining 
the new noises into two effective new noise processes ®i and ®2 jEH §1-5], 
the model ()22|) vastly simplifies to the weak model 3 

d = 0.01654 cr 2 a - ^a 3 - ^a 5 

+ act)! + |acrcb2 + a 2 cr(i<h + ^ch 3 ) + aV^fo 

+ 0.07144 a 2 ®! + 0.02999 o 2 a® 2 + 0(a 6 + a 3 ) . (23) 



The Stratonovich model (j23|) is a weak model of the original Stratonovich 
SPDE ((TJ) because we have replaced detailed knowledge of the interactions of 
rapid fluctuations, seen in the convolutions of (|2~Tj) . by their long time scale 
statistics; similarly Just et al. jTHj replaced detailed knowledge of rapid chaos 
by its long time scale statistics. Vanden-Eijnden comments that stronger 
results can be obtained. However, resolving rapid fluctuations seems futile 
when they are stochastic, as required for this section, because describing them 
as stochastic admits we do not know their detail anyway. The model (j2HJ) 
is useful because it only resolves long time scale dynamics and hence, for 
example, we are empowered to efficiently simulate it numerically using large 
time steps. 

3 Thc combinations crc}>i + 0.07144 cr 2 ®! and ^aofc + 0.02999 cr 2 a® 2 in {2| could be 
combined, but then one must be careful with the correlations with the other noise terms 
on the second line of J23). 
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But furthermore, we readily discover crucial stability information in the 
weak model (J2HJ). See that the quadratic interactions of noise processes, 
through stochastic resonance, generate the mean effect term 0.01 654 <j z cl. 
As it is a term linear in a with positive coefficient 0.01654 a 2 , this term 
destabilises the origin. Roberts [HI] demonstrated in numerical simulations 
how the same term in cr 2 a, but with a negative coefficient, stabilises the 
origin as expected. Thus here we are empowered by our analysis to predict 
instead that the stochastic solutions of the spde (JJJ will linger about and 
switch between two fixed points obtained from the deterministic part of (j23j) . 
namely u ~ asinx for amplitudes a ~ ±0.45 o\ 

Return to the full spectrum of noise (JHI) Now we deal with the full 
complexity of the infinite sums of nonlinear noise interactions in the strong 
model ©. First, see that we obtain the exact numerical coefficient for the 
stochastic resonance term 0" a for the full spectrum of noise through the 
infinite sum Y-v=3 c k < t , k^i< c t ) k • Terms of this form are the only ones con- 
tributing to this stochastic resonance. The exact numerical coefficient is 
thus (1/18 - 1/44 + Lk=3 c k)/ 2 = 0.016563 to five significant digits. Curi- 
ously, in this problem, it is only the (|)2sin2x component of the noise that 
acts to stabilise u = through its negative contribution to this sum, as ex- 
plored in [H3]> all other noise components act to destabilise u = through 
their positive contribution. 

Second, and similarly, the other infinite sums over the noise compo- 
nents in (JSJ) modify the coefficients in the weak model (J2HJ)- But, as for 
the stochastic resonance term, the modification to the coefficients are not 
large: the plain a 2 term from the third line of © has coefficients ~ 1 /k 2 but 
(|) k _i_-|7i k (|) k ~ 1 /k (from (|T9|) and that (3 ~ k 2 ), so that the terms in the sum 
are ~ 1 /k 3 ; similarly the infinite sums in lines 6-8 of dHJ) have terms ~ 1 /k 4 
or smaller. Further, when combining the infinitude of new noise terms in 
the analogue of (|22j) to find the exact version of the weak model f!23|) . the 
coefficients are the root-sum-squares of the coefficients of the new noise pro- 
cesses in the infinite sums; thus terms (9(1 /k 3 ) and (9(1 /k 4 ) in the sums are 
effectively terms (9(1 /k 6 ) and 0(1 /k 8 ) . Indeed, computer algebra [HHl §1-5] 
demonstrates that at most ten terms in these sums determine the coefficients 
of the weak model correct to five significant digits, namely 

d = 0.01 6563 a 2 a - ^a 3 - ^a 5 

+ ach + |aa4> 2 + a 2 ff(^4>i + ^cb 3 ) + a 3 o-^cb 2 

+ 0.071 843 a 2 ©! +0.030368 a 2 a0 2 + C (a 6 + a 3 ) . (24) 
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The weak model (J23J) with just the three main noise processes has coefficients 
correct to about 1% when compared to this model for the full spectrum of 
noise. 

5 Higher order analysis requires more 
convolutions 

In the strong model (jOJ) we only seek to resolve the quadratic noise terms 
in a 2 and a 2 a. If we seek quadratic noise terms of higher order in the 
amplitude a, such as terms in o" 2 a 2 and cr 2 a 3 , then we would face more 
convolutions of the noise, such as 4>j7Y s 7Y T 7Y q 7Y p cbi , for example. At higher 
orders the infinite sums over the noise modes would have been considerably 
more complicated. Such complication may be difficult to handle, but the 
techniques are routine; whereas here the techniques have to be extended to 
handle more convolutions of the noise processes. 

To handle more noise convolutions and thus be more complete we have to 
extend the canonical system of noise interactions (jl2|) . For possibly n con- 
volutions of noise processes, extend the system (|T2*j) to discuss 

ih = z-icbj , Z! = -|3iZ! + cbi, 

t)2 = Z 2 ct) j , Z 2 = -(3 2 Z2 + Z! , 

; ; (25) 

y n = z n cbj , z n = -|3 n z n + z n _i . 

Recall that the constants (3k appearing here are just the decay rates of var- 
ious of the fundamental modes of the linearised spde. Thus the results of 
this section from analysing this canonical hierarchy of quadratic noise effects 
apply to general dynamical systems. 

Consider the Fokker-Planck equation for the PDF P(y , z, t) of the canon- 
ical system ()25|). it is a straightforward extension of the Fokker-Planck equa- 
tion ()14j). again recall that we adopt the Stratonovich interpretation of SDEs: 

BP r) n r) c) 2 P 

^ = ^_(|3 1 z 1 P) + >"^-[(p ]cZlc -z lc _ l )P] + ^ 

at az! az k L azf 
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Using the same arguments as in Section HJ treating derivatives as asymp- 
totically small parameters, this Fokker-Planck equation has a centre man- 
ifold, that is exponentially quickly attractive, and may be constructed by 
making the residual of the Fokker-Planck equation IJ26j) zero to some order. 
For a given number of convolutions n, computer algebra §2] readily de- 
rives the terms in the centre manifold model (|15H16|) . For example, it appears 
that the leading order Gaussian can be written in terms of a sum of squares 
as Go = Aexp(— PkCk.) where 

Ci = zi , 

C2 = z 1 -((3 1 + (3 2 )z 2 , 

C 3 = z, -(P, +2p 2 +p 3 )z 2 +(Pip2+(Pi + p2 + p 3 )P 3 )z 3 , 
C 4 = z, - (Pi + 2(3 2 + 2(3 3 +(3 4 )z 2 

+ (frfo + (2|3i + 2(3 2 + 2(3 3 + (3 4 )|3 3 + (P, + |3 2 + (3 3 + p 4 )p 4 )z 3 
- ((3i|3 2 |3 3 + (P1P2+ |3i(3 3 + |3 2 |3 3 )(3 4 + ((3i + (3 2 + (3 3 + p 4 )P^z 4 . 

However, using this algorithm, determining terms in Vp and Wp requires 
more computer memory and time than I currently have available for any- 
thing more than the case of rv = 3 general noise convolutions with (3^ as 
variable parameters. 4 For the accessible rv = 3 case, we find the relatively 
slowly varying, quasi-conditional probability density p evolves according to 
the Fokker-Planck like pde f|17|) but now the 3x3 diffusion matrix has entries 

1 

4(37' 

1 

4(3 1 ((3 1 + (3 2 ) ' 
1 

4(3 1 |3 2 ((3 1 + (3 2 ) ' 
1 

4|3 1 (|3 1 + [3 2 )([3 1 + f3 3 )' 

Pt + P 2 +P 3 

4(3,132(13, + |3 2 )(|3 1 + |3 3 )(|3 2 +|3 3 ) ' 

Pi + p2+P 3 (2?) 

4p 1 p 2 p 3 (P 1 + P2)(P 1 + P 3 )(P2+P 3 ) ' 1 1 

The 2x2 upper-left block is reassuringly identical to the earlier diffusion 
matrix (|T8|) . 

4 For any specific convolution of noises, when the coefficients (3i are all specified num- 
bers, the computer algebra of |35l §2] analyses the case of n = 4 convolutions within 
20 seconds CPU on my current desktop computer. 
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Fortunately, the alternative derivation in Appendix [X] of the diffusion 
matrix D is significantly more efficient. Computing the 4x4 diffusion ma- 
trix I find the expressions extremely complicated and apparently not worth 
recording. But the Cholesky factorisation is accessible. 

Recall that to interpret the pde (JT7jl as a Fokker-Planck equation of 
some SDEs, we desire the Cholesky factorisation of the diffusion matrix. The 
Cholesky factorisation here is D = ^LL T for lower triangular matrix L with 



non-zero entries 

Ln = 

L 21 = 

L 22 = 

L 3 i = 

L 32 = 

L 33 = 

L 41 = 

L42 



1 



1 



i 

1 

VZ£7(3i + 32)(3i + p 3 ) ' 
i 



v / 2P2(Pi + (3 3 ) 
1 



1 1 

+ 



(3t + (3 2 (3 2 + (3 3 



1 

v ^37((3 1 + (3 2 )((3 1 + (3 3 )((3 1 + (3 4 ) ' 



1 



v / 2p 2 (P 1 + (3 3 ) 



1 



:(32 +(3 3 )((3 2 +|3 4 ) 



+ 



1 



+ 



1 



(3i + (3 4 )((3 2 +|3 4 ) ((3 1 + (3 2 )((3 1 + (3 4 ) 



L 



1 



43 



1 



:i3i + |3 3 )(|3 2 +|3 3 ) 



+ 



1 



+ 



1 



((3 1 + (3 4 )((3 3 + |3 4 ) ((3 1 + (3 3 )((3 1 + (3 4 ) 
1 



v / 234(Pi + (3 4 )((3 2 +(3 4 )((3 3 +(3 4 ) 



(2? 



The upper-left entries are also reassuringly identical to the earlier 2x2 
case (|20[). These formulae empower us to transform general quadratic non- 

5 There are some intriguing hints of relatively simple patterns developing in the entries 
of L. Maybe an even more direct derivation via a change in measure for the hierarchy (|25|l 
could be exploited to derive general formulae for more convolutions of noise. 
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linear combinations of noise processes into effectively new and independent 
noise processes for the long time dynamics of quite general SDEs and spdes. 

6 Conclusion 

The crucial virtue of the weak models fll| and (J2U), as also recognised by 
Just et al. jTHj, is that we may accurately take large time steps as all the 
fast dynamics have been eliminated. The critical innovation here is we have 
demonstrated, via the particular example spde how it is feasible to 
analyse the net effect of many independent subgrid stochastic effects. We see 
three important results: we can remove all memory integrals (convolutions) 
from the model; nonlinear effects quadratic in the noise processes effectively 
generate a mean drift; and nonlinear effects quadratic in the noise processes 
effectively generate abstract new noises. The general formulae in Section El 
together with the iterative construction of centre manifold models |2H], em- 
power us to model quite generic spdes. 

My aim is to construct sound, discrete models of spdes. Here we have 
treated the whole domain as one element. The next step in the development 
of this approach to creating good discretisations of spdes is to divide the 
spatial domain into finite sized elements and then systematically analyse their 
subgrid processes together with the appropriate physical coupling between 
the elements, as we have instigated for deterministic pdes (2H1 EHJ EH e.g.]. 

A Ito proves quadratic stochastic resonance 

In this Appendix we resort to Ito interpretation of SDEs rather than the 
Stratonovich interpretation used throughout the body of this work. This 
Appendix considers some of the properties of noise quadratically interacting 
with itself that were established through Fokker-Planck equations in Sections 
13] and |SJ Here we provide alternate more direct proofs of some of these 
properties. 

A.l Noise interacting with itself over long times 

This subsection analyses the simplest case of one noise quadratically interact- 
ing with itself, that is, 4>i = (J)j . Thus we explore the large time dynamics of 
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the first pair of Stratonovich SDEs in (II 2|) . The equivalent Ito SDEs, written 
in the more usual capital letters, is for some Wiener process W 

dY = ±dt + ZdW and dZ = -|3Z dt + dW , (29) 

where all subscripts are omitted for simplicity, Y = , Z = Zi and dW = 
<J)j dt = <t)i dt . 

Consider the dynamics over any time interval [a, b], provided times a and b 
are large enough for initial transients to have decayed, and for simplicity use 
just J" to denote J" and just A to denote the difference []t=a- 

Theorem 1 The process Y has drift j and variance growing linearly at a 
rate 1/(2(3). 



Proof: Integrate the Y equation to AY — jAt + J Z dW and take ex- 
pectations: 

U 



E [AY] = ±At + E 



ZdW 



by the martingale property of Ito integrals. Hence Y has drift j. 



Now consider 



Var[A(Y-±t)] = Var 



ZdW 



E [Z 2 ] dt by Ito isometry 
At 

as Z is a well known Ornstein-Uhlenbeck process. Hence the variance of Y 
grows linearly at rate 1/(2(3) . 

Rather than appeal to Z being an Ornstein-Uhlenbeck process we could 
instead recognise Z = J exp{— |3(t — s)}dW s , from the defining convolu- 
tion; then 



E[Z 2 ] 



Var 



exp{-(3(t-s)}dW s 



which by the Ito isometry 

t 

E [exp{-(3(t- s)} 2 ] ds 
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exp{-2|3(t- s)}ds 

1 

as before. The next subsection uses this route to find covariances with any 
number of convolutions. 4k 

Given that AY approaches as Gaussian over long time scales, as estab- 
lished in the Fokker-Planck analysis leading to fTTHT8|) and shown in some 
numerical simulations by Chao & Roberts PJ, the process Y may be thus 
modelled over long time scales by the SDE dY = ^dt + -^qjdWi for some 
Wiener process Wi, as analogously derived in (|19jl . But before this corollary 
is of any use, we need to establish that the Wiener process Wi is effectively 
independent of the original Weiner process W when viewed over large time 
scales. The next theorem shows the correlation E [AW ■ AW]] = . 

Theorem 2 For the processes Y and Z with Ito SDE A29\) . the correlation 
E [AW • A(Y — ^t)] = , and hence the increments AW and A(Y — ^t) are 
independent. 

Proof: Trivially E [AW • At] = , so we need only consider E [AW • AY] . 
Since ( W - W Q ) ( Y - Y Q ) = at t = a , it follows that 



Hence 
E [AW • AY] 



AW ■ AY = A{(W - W Q ) (Y - Y Q )} . 
E[A{(W-WJ(Y-Y Q )}] 



E 

E 

E 

+ 
0, 



d{(W-W Q )(Y-Y Q )} 
which by Ito's formula |2J p.62, e.g.] 



Y- Y Q + Z(W- W Q ) dW + 



Y- Y Q + Z(W- WJ dW 



Z + I(W-W Q )dt 



E[Z] + ^E[W-W a ] dt 



by the martingale property of Ito integrals, by the fact that Z is an Ornstein- 
Uhlenbeck process and hence has zero expectation after any initial transients, 
and since Wiener increments have zero expectation. Consequently, the in- 
crements AW and A(Y — It) are independent. 4fc 
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Two distinct and interacting noises Now turn to the case of one noise 
interacting with another, that is, when 4h ^ cbj . Thus explore the large time 
dynamics of the first pair of Stratonovich SDEs in (112)1 . Now the equivalent 
Ito SDEs for some independent Wiener processes W and W are 



dY = ZdW and dZ = -|3Z dt + dW , 



(30) 



where dW = cbj dt and dW = (Jh dt . 

As in the proof of Theorem Q write the increments AY = J Z dW and 
then the martingale property and Ito isometry assure us that E [AY] = and 
Var [AY] = At/(2(3) . Similarly to the proof of TheoremEl the increment AY 
is uncorrelated with both AW and AW — use Ito's formula for products of 
processes that depend upon multiple noises p. 185, e.g.]: 



E [AW ■ AY] = E 

= E 

= E 

= 0; 

E [AW - AY] = E 

= E 

= E 

= 0. 



d{(W-W Q )(Y-Y a )} 



(W-W Q )Z+(Y-Y Q )dW + 



(W-W Q )Z+(Y-Y Q )dW 



Zdt 



E[Z] dt 



d{(W-W Q )(Y-Y a )} 



(W- W Q )ZdW + 



Y - Y Q dW 



(W- W Q )ZdW 



+ E 



Y - Y Q dW 



Consequently, given that AY approaches as Gaussian over long time scales, 
we may model the process Y by the SDE dY = -^jdW! for some effectively 
independent Wiener process Wi, as analogously derived in (fTTJl) . 

This subsection gives alternative and more direct proofs of some of the 
Fokker-Planck analysis of Section 0] on the most elementary canonical noise 
interactions. However, this subsection does not establish the key property 
that the increments AY approaches a Gaussian for long times. Instead the 
Relevance Theorem of centre manifolds together with the structural stability 
of the Fokker-Planck equation ()T7)) assure us of this key property. 
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A. 2 Multiple convolutions of quadratic noises 

To complete the analysis we here explore noise processes interacting with 
multiple convolutions of their past history. Thus consider the Ito version of 
the Stratonovich hierarchy ()25j) : 

dY, = Jsdt + Zi dW, dZ, = dt + dA^, 
dY 2 = Z 2 dW, dZ 2 = (-(3 2 Z 2 + Z 1 )dt, 

; ; (si) 

dY n = Z n dW, dZ n =(-(3 n Z n + Z n _ 1 )dt, 

where W = W in the case of a noise interacting with itself, s = 1 , otherwise 
they are independent, s = . Ito calculus provides alternate confirmation, 
to that derived in Section of the effective large time dynamics of the 
processes Y m . 

The processes Y m have zero drift except for the case W — W when instead 
process Yi has drift \. We need the covariances of the fluctuations in these 
processes in order to establish that the correlations among the fluctuations is 
determined by the lower triangular matrix L in (|28jl . For conciseness define 
the fluctuation process 2) m = Y m — 6 m i^st . 

Theorem 3 The expectation E [A^nJ = for all m, and the covariances 
E [AS^ASJnJ are given by the corresponding elements in AtLL T for the lower 
triangular matrix L in h2ty . 



Proof: Firstly, immediately from definition of 2) m and the Ito SDEs ([31|L 
d2) m = Z m dW. Recall that an unadorned J denotes J and A denotes 
the difference [ Thus A2) m = JZ m dW, then by the Ito isometry 

ECASjJ-O. 

Secondly, consider the covariances 



E [ASkA^J = E 



Z k dW 



Z m dW 



E [Z k ZJ dt , 



(32) 



by an extension of the Ito isometry. 

Find these covariances by observing, and this is actually the definition 
from convolutions of the right-hand column in the hierarchy (|31j) . 



rt 



z, 



-iMt-s) d vfr and z _ 



rt 



-Pm(t-S) 



Z m _i(s) ds 
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The first is an Ito integral. Turn the others into Ito integrals by defining 



pt 



hi (t) = e~ p1 * and h m (t) = e~ |imt * H m _-, (t 



0m t 



-0m (W 



for example, when the decay rates (3 m differ 
h 2 (t) = 



h m _i(s) ds; 

(33) 



e -|3 2 t _ e -Pit 



Pi -p; 



-Pit 



-p 2 t 



-03 1 



H,ft) 



+ 



+ 



(Pi " P 2 )(Pl " P 3 ) (Pi- P 3 )(P2- Pi) (P3- Pl)(P 3 - P2) 

Then inductively 



Z, 



-Pm(t-T) 



hm-i(T-s) dW s dT 



s 

r-t-s 



h m (t-s)dW s 



Consequently, by an extension of the Ito isometry 



E[Z m Z k ] 



E 



pt 



pt 



H m (t-s)dW s 



hv(t-s)dW s 



E [H m (t- s)h k (t- s)] ds 



H m (t)H k (t) dt 



(34) 



Computer algebra (33 §3] readily computes the convolutions and integrals 
in equations (|3*3|) and (p£f|. The resultant covariances E [Z k Zm] are correctly 
twice the corresponding elements in the diffusion matrices D in f!18|) and (|27j). 

The computer algebra j^Sl §3] easily computes higher order covariance 
matrices. But the expressions for order m > 4 are too hideous to record in 
detail here. However, records the expressions computed for the fourth 
order Cholesky factorisation. 4fc 

The factorisation (|28|) is needed to weakly model convolutions of noise by 
effectively new and independent noises as discussed in Section HJ But again, 
we need to be sure that these effectively new noise processes are independent 
of the original processes W and W. 
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Theorem 4 For the processes Y m and Z m with Ito SDE hSl\) . the correlation 
E [AW • A2) m )] = E [AW ■ A2) m )] = , and /jence the increments AW, AW 
and A2) m are independent. 



Proof: As in Theorem H since (W - WJ (2) m - 2} ma ; 
follows that 

AW • A2) mQ = A{(W - W Q ) (2) m - 2) ma )} . 



at t = a , it 



Hence, using Ito's formula for products of processes that depend upon mul- 
tiple noises p. 185, e.g.] 

EfAW-A^J = E[A{(W-W a )(2) m -2) mQ )}] 



= E 

= E 

= E 
= 0, 



d{(W-W Q )(2) m -2) ma )} 



ma 

+ Z m (W-W Q )dW + 



Z m dt 



2)-2) mQ + Z m (W-W Q )dW 



+ 



E [Z J dt 



by the martingale property of Ito integrals, including Z m = J* H m (t — 
s) dW s as deduced above. Consequently, the increments AW and A2) m are 
independent. 

Similarly, 

E[AW-A2) m ] = E[A{(W-W a )(2) m -2) mQ )}] 



= E 

= E 

= E 
= 0, 



d{(W-W a )(2) m -2) mQ )} 



?)m-2)madW + 



(W-W Q )Z m dW 



?)-2) ma dW 



+ E 



(W-W Q )Z m dW 



by the martingale property of Ito integrals. Consequently, the increments 
AW and A2) m are independent. 4 
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